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(57) Abstract 

An on-screen menu method and system for controlling the functions of integrated electronic devices and a television schedule system 
and method for displaying television schedule infomiation on a television screen includes a program guide having a schedule information 
area that depicts the programs that are being presented on each channel at each time during the day and an interconnected series of menus 
to control the features of the integrated electronic devices. An input device allows the viewer to move a pointer over different interactive 
areas of the guide and the functions performed when the area is activated is displayed in a contextual help window. Various control glyphs 
provide for recursive interaction with the guide. 
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TELEVISION CONTROL INTERFACE WITH ELECTRONIC GUIDE 

BACKGROUND OF THE INVENTION 

This patent application is related to a U.S. 
Provisional patent application entitled "Seamless. Television 
Control Interface with Electronic Guide," U.S. Application No. 
60/039,278, which was filed on February 28, 1997, of Alba et 
al . , the disclosure of which is incorporated by reference for 
all purposes. 

The present invention generally relates to 
television schedule information, and more particularly to a 
system and method for displaying a television program guide on 
a television screen. 

As the number of television stations in a 
metropolitan area or on a cable network has increased, the 
number of programs of potential interest that are presented to 
a viewer has risen dramatically. With the use of dish 
antennas capable of receiving direct satellite signals, the 
multitude of programs available to the viewer has further 
increased. 

Additionally, television faces a digital future that 
will ^ee the merger of television and PC technology. The 
television set of the future will include a micro- computer , a 
modem of interconnectivity with other computers over networks, 
intranets, and the internet, and be connectable to computer 
peripherals such as printers. Such capabilities as near 
"video on demand" (NVOD) , "video on demand", access to the 
world wide web", "audio on demand", etc. will be present the 
viewer with a plethora of information and bandwidth. In 
addition to PC capabilities, viewers will want to control 
other consumer electronic devices such as VCR's and surround 
sound receivers. 

As has become increasingly evident, information 
overload can actually reduce the usefulness of the information 
delivered. Accordingly, a great challenge exists to provide 
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an interface that manages and provides an intelligent, user- 
friendly interface to the information available. 

Consequently, television schedule systems or 
electronic program guides (EPG) that are provided directly on 
5 the viewer's television screen have been developed to assist 
the viewer in sorting through these various programs and 
determining which programs to watch or record* One such 
television schedule system is disclosed in commonly assigned 
U.S. Patent No. 5,353,121 (Young et al . ) , the complete 

10 disclosure of which is hereby incorporated by reference. In 
one embodiment of Young, the television schedule includes a 
series of menu screens having an array of cells corresponding 
to different television programs. The viewer may scroll 
through the cells to view which television programs are being 

15 presented on various channels at various times. In addition, 
the viewer may select certain cells to obtain more information 
on the associated program or to pull up other sub -menus with 
additional options . 

The recent development of television schedule 

20 systems, such as the above described patent to Young, have 

created many new challenges. One such challenge is to manage 
intelligently the vast stores of information available and 
provide user access and control directly through an electronic 
program guide. Another challenge is to facilitate easy access 

25 to a wide range of functionality through the combination of a 
limited number of user interactions. And still another 
challenge is to control several differing integrated 
electronic devices with the same ease of use incorporated into 
each. 

30 SUMMARY OF THE XNVEHTION 

The present invention 'Jjrovides a system and method 
of accessing a series of menus for controlling a variety of 
integrated electronic devices and for displaying schedule 
information on a visual interface, such as a television 
35 screen, a computer monitor or the like. An integrated 

electronic device is any device that has been configured to 
accept and perfoarm the commands of the on-screen menuing 
system. The p^resent invention also provides a system and 
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method for allowing the viewer to navigate and interact with a 
program guide that is displayed, for example, on the viewer *s 
television screen. The program guide will usually include a 
schedule information area that depicts the programs that are 
being presented on each channel at each time during the day. 
With an input device, such as a remote control device, 
pointing device, mouse, keyboard, microphone or the like, the 
viewer: can browse through the schedule information area and/or 
obtain more information about programs of particular interest. 

According to one aspect of the invention, actions 
are directly invoked by moving a pointer over are^s of the 
visual interface and selecting or "clicking" on the area. 

In one aspect of the invention, a system and method 
is provided for allowing the viewer to utilize display action 
controls, configured as glyphs, to recursively vary the 
configuration of the display area. Each glyph is activated by 
a point and click action of the user input device and serves 
as a switch for changing between two modes . 

According to one aspect of the invention, a system 
and method is provided for accessing a series of menus and 
host functions that control a variety of integrated consumer 
electronic devices . 

According to one aspect of the invention, a system 
and method is provided for allowing the user to easily change 
the tiine frame displayed on the EPG guide, and the 
accompany img viewer guide by activating the time bar glyph and 
then activating a specific time indicator glyph. 

According to one aspect of the invention, a system 
and method is provided for changing the configuration of the 
pointer /cursor to provide the user with additional or 
alternate information. The pointer/cursor changes depending 
on the location of the pointer/cursor on the EPG display 
guide . 

According to one aspect of the invention, a system 
and method is provided for graphically depicting the current 
time and the show time remaining by displaying a transparent 
shadow that proceeds across the EPG screen from left to right. 
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Other features and advantages of the invention will 
be apparent in view of the following detailed description and 
the appended drawings . 

5 BRIEF DESCRXPTION OF THE DRAWINGS 

Fig. 1 is a representation of an embodiment of the 
EPG display of the present invention. 

Fig. 2 is a block diagram of a TV system. 

Fig. 3 is a block diagram of a hardware unit for 
10 generating an on-screen electronic programming guide (EPG) . 

Fig. 4 is a schematic diagram of the hierarchical' 
database utilized to generate the EPG. 

Figs. 5A-5D are schematic diagrams of data 
structures in the database . 
15 Fig. 6 is a flow diagram of a menuing hierarchy. 

Fig. 7A is a screen depiction of a series of sub- 
menus . 

Fig. 7B-7C are screen depictions of a series of host 
function commands. 
20 Fig. 7D-7E are screen depictions of a series of sub- 

menus . 

Fig. 7F is a screen depiction of a series of host 
function commands . 

Fig. 8 is a screen depiction of the current time 
25 data depicted as a darkened area on the EPG screen. 

Fig. 9 is a screen depiction of the Time Bar glyph 
which includes a series of Time Indicator glyphs. 

Fig. lOA-lOC are screen depictions of the 
pointer/cursor which depicts alternate or additional 
30 information. 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 

Overview of the Interactive Screen 

The present invention provides an on-screen menuing 
system and method for controlling several integrated consumer 
35 electronic devices and a schedule system and method for 

displaying schedule information on a visual interface, such as 
a television screen, computer monitor or the like. The system 
and method is particularly useful for use with television 
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schedule information. The television schedule information is 
presented in a program guide having a schedule information 
area depicting the program that is being shown on each channel 
for a period of time, e.g., a day, week or longer. 
Additionally, the EPG displays the controls of functions for 
various integrated electronic devices in a series of menus . 

The on-screen menuing system provides a series of 
interactive menus. These interactive menus include commands 
to control the functions of the connected electronic devices 
that are configured to accept and perform the commands of the 
on-screen menuing system. 

The on-screen menu system and method for controlling 
several connected electronic devices and television schedule 
system include an input device, such as a remote control 
device, pointing device, mouse, keyboard, microphone or the 
like, to allow the user to browse through the menu or schedule 
information area, obtain more information about programs of 
particular interest and control various features of the 
integrated electronics . 

The controller may comprise a trackball, cursor 
controller, pointing device, a microphone for allowing voice 
activation, a number of keys or buttons that function to move 
the viewer around the screen, or the like. In the preferred 
embodiment, the controller comprises a scrolling mechanism for 
displacing a movable cursor through a matrix of cells or 
windows on the screen. The cursor may comprise a physical 
icon on the screen, or it may be represented by highlighting 
or other visual indications of the cells or windows that are 
scrolled through by the viewer. 

Figure 1 illustrates a program guide 102 for the 
television schedule system of the present invention. The 
program guide 102, which is the primary mode in the television 
schedule system, includes a number of screen information areas 
or windows in a particular screen where the viewer operates an 
input device, such as a pointer device described above, to 
move around vertically and horizontally and to interact with 
that screen area's function. Preferably, the currently active 
screen area will be indicated to the viewer, for example, by 
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changing the background color from a light grayscale metallic 
to a brighter, active color. Within each screen area are one 
or more items, typically arranged in a matrix or grid so that 
the viewer can scroll through the grid- The items can be 
5 selected or activated with the input device. 

As shown in Fig, 1, program guide 102 preferably 
includes a schedule information area 10 6 having a program 
matrix 108 of cells or items that depict the shows that are 
being presented on each channel at each time during the day. 

10 Program guide 102 conveniently lists the channels in a 

vertical column to the left of the program matrix 108 and the 
times in a time bar 602 in a horizontal row above matrix 108. 
The viewer selects an area by moving a pointer 110 over the 
area associated with a desired action. When the pointer 110 

15 is moved over an area, the item may be automatically 

highlighted with a brighter color to indicate the viewer's 
location. 

In Fig. 1, program guide 102 includes a number of 
other information areas. For example, program guide 102 
20 includes a display title area 200 that includes a display mode 
icon 202 and a display mode description text field 204. An 
interactive data control window 206 displays the date for the 
listings in display matrix 108 . 

Directly below the display area 108 are four small 
25 action controls 208-211 which give the viewer the ability to 
recursively vary the configuration of the display area 108. 
The operation and functions of these action controls is 
described in detail below, A world icon 214 may appear below 
the display area on the left side and a star (linked services 
3 0 available) icon 216 may appear directly below the display area 
on the right side. 

A video window 220 may display a currently- tuned 
television show. Below the video window 220 is a channel 
window 222, a title window 224, and a current time display 
35 window 226. Each of these windows are interactive. 
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Overview of an EPG System 

A detailed description of The EPG system, may be 
found in U.S. patent application no. 08/906, 073 and so is 
herein incorporated by reference for all purposes, 
5 In a preferred embodiment, the electronic program 

guide of the invention may be implemented either on a personal 
computer, a PCTV, a television connected to a set -top box, or 
a television including a custom board. However, the invention 
is not limited to any particular hardware configuration and 

10 will have increased utility as new combinations of computers 

and television systems are developed. In the following any of 
the above will sometimes be referred to as a "TV system" . 
Block diagrams of representative TV systems are depicted in 
Fig. 2. Details of implementation are not depicted because 

15 the invention is not limited to any particular TV system. 

As is well known, the picture to be displayed may be 
transmitted as an analog signal, for example according" to the 
NTSC standard utilized in the United States, or as a digital 
signal modulated onto an analog carrier. The signals may be 

20 received over a cable, or via an antenna or satellite dish. 
Typically, television sets are designed to receive analog 
signals and computers display devices are designed to display 
pictures encoded in a digital format. However, decoder system 
converts the digital data to an analog signal for display on a 

25 television set and TV modems can format analog TV signals for 
display on a monitor. 

In Fig. 2, analog or digital TV signals, received 
via cable 330, antenna 332, or satellite dish 334, are 
provided to a television system. If the signal is from a 

3 0 digital broadcast service, then a decoder 336 converts the 

signal to baseband video and audio or channel 3/4 RF. If the 
signal is an analog signal it is passed through as a video 
output. The television system 338, depending on its 
configuration, receives selected ones of the outputs and 

3 5 displays the received program . 

A PCTV includes a TV card 340, connected to either 
live video, baseband video, or channel 3/4 output, digitizes 
the video image and displays the video image in a resizable 
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window on the computer monitor. The PCTV is also coupled to 
land telephone lines by a modem 342. 

If the received signal is an analog TV signal the TV 
card of the PCTV digitizes the analog signal and extracts 
included information from the vertical blanking intervals 
(VBI) . On the other hand, if the signal is a digital signal 
separate audio, video, VBI (vertical blanking information such 
as "closed caption, teletext, current time data and program 
related information) , program guide, and conditional access 
information are provided as separate bitstreams. The video 
and audio bitstreams for programs are converted to a format 
for display and the program guide information is processed to 
form program guide database. The processor, executing 
software stored in memory, generates interactive electronic 
program guide images and images of received programs. The 
guide can be used to interact with and control programs 
displayed in the window. 

A television system configured to display an 
electronic program guide such as a guide provided by StarSight 
telecast includes an on-screen display controller and other 
hardware described below. If a standard analog broadcast 
signal is received program guide data, including current time 
data, is extracted from the VBI by a VBI data slicer and 
processed to form a program database. If a DBS digital signal 
is received, either from a satellite or cable, VBI and program 
data, including current time data, are provided in separate 
bit streams . The program guide images are generated are 
either generated locally or remotely and provided to an on 
screen display controller. Interactivity is provided via a 
remote control . 

Alternatively, the program guide can be displayed on 
a computer monitor that interactively controls the television 
set through, for example, an IR interface including an IR 
blaster 344 to generate IR codes to control a television, a 
VCR and/or any other connected electronic device configured to 
accept and perform the commands of the on-screen menuing 
system. 
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If the electronic guide database is generated 
locally the system for creating the electronic programming 
guide must receive television schedule information and process 
the received information to create a database. Thus, the 
system requires, a data reception unit, a processor, memory to 
store program code and a database, an on-screen display 
generator (OSD) , and a control interface for tuning to 
selected channels. 

In one preferred embodiment, the schedule 
information is transmitted as a set of short commands of 
specified formats. Different commands . communicate information 
such as a show schedule for a given channel, the title of each 
show in the schedule, descriptions and information attributes 
about each show in the channel. Thus, information for a show 
to be broadcast at a particular time is transmitted in several 
commands. ID numbers in the commands facilitate organizing 
the information into a relational database utilizing database 
engine (DBE) software stored in memory and executed by the 
processor. 

In a preferred embodiment, a board is included at a 
viewer's television set and the database is stored locally and 
commands are transmitted in the vertical blanking intervals 
(VBI) of programming on a designated channel, for example PBS. 
An example of a board for receiving program guide information, 
generating program guide database, displaying the program 
guide, and interactively controlling the program guide is 
depicted in Fig. 3. The commands are transmitted to the board 
in the vertical blanking intervals of programming broadcast on 
a designated channel . 

Alternatively, the commands could be transmitted to 
the local unit over land telephone lines. Additionally, as 
described below, in some systems the database is built 
remotely and the guide itself is transmitted to the local 
unit . 

The database engine builds a hierarchical database 
in the RAM. The hierarchical structure of the database is 
depicted in Fig. 4. The database is structured internally as 
schedule data structures and theme data structures linked by 
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handles and handle tables. Each handle is an index to a 
handle table which contains pointers to blocks of memory where 
items of the database are stored ♦ 

In another embodiment, for example a DSS system, 
5 program guide data is transmitted as a bit stream that is 
processed by the database engine. 

Additionally, a N.E.W.S. (new^ entertainment, 
weather, and sports) database has been developed. Commands 
including story text and story IDs are transmitted. Links 
10 from the program guide to stories related to a program can be 
created and the related stories can be accessed ^rom the 
guide . 

An advertisement database is also created from 
commands including advertising text and logos including IDs 
15 for linking the ads to shows displayed in the EPG. The user 
may access the advertising information directly from the 
guide . 

An internet database is also created from commands 
including URLs to internet sites related to programs displayed 
20 on the EPG. If the viewer is viewing the EPG on a platform 

that is Web enabled, e.g., WebTV, a PC, or PCTV, then a linked 
site can be accessed directly from the EPG. 

Additionally, a graphics program module builds 
various displays utilizing schedule, show title, and other 
25 information from the database. If the OSD controller operates 
in the character mode the display is a grid of character codes 
which are transferred to the on-screen display (OSD) 
controller which generates the on-screen display - 

^An input -response user interface program module 
30 responds to user input to generate new displays responsive to 
the particular input. In one preferred embodiment, the user 
utilizes an input device, e.g., a remote control, mouse, or 
keyboard, to place a pointer over a part of the current 
display and clicks. The input -response module responds to the 
35 position of the pointer and the particular display currently 
displayed to generate a responsive display or take a 
particular action. In another preferred embodiment the user 
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interface responds to function buttons on a remote control. 
Specific examples will be described below. 
Board Description 

Fig. 3 is a block diagram embodiment of the 
5 electronic hardware unit 452 utilized to perform the 

electronic on-screen schedule display and other functions. 
The particular hardware unit 452 depicted is for TVRO (TV 
Receive Only) customers having home satellite dishes for 
television viewing. This unit is coupled in series with 

10 existing customer TVRO equipment. 

In Fig. 3, the unit receives Baseband Video in 423 
from the customer TVRO system. The unit optionally outputs 
Baseband Video out 428 or channel 3/4 RF out 430. The unit 
includes an 8 -bit microprocessor 4 00, 64 bytes of code ROM 

15 401, 512 K of RAM 4 02 for program data storage, a custom gate 
array 403, segmented base registers 404 for fast memory data 
manipulation, security logic 406 for decoding incoming 
encrypted data, a serial bus 408 for display controller 
interface, serial bus 410 for inter-processor communication, 

20 watchdog timer 412 for error recovery, IR input 413, IR 

transmitter circuits 416 for TV, VCR control, IR output 417, 
CRC-32 encoding and decoding logic 418, on-board power supply 
420, video input 423, On-Screen Display Controller and 
Formatter 424, custom color converter 42 6, RF modulator 427, 

25 choice.pf Baseband Video or RF outputs 428 or 430. 

The on-screen display controller and formatter 
(OSDCF) 424 functions as an I/O controller, an on-screen 
display controller (OSD) , and also as a closed-caption data 
(CCD) VBI vdata slicer. The VBI (vertical blanking interval) 

30 is a dead space in a TV signal that allows a television signal 
to reposition the scanning electron beam from the bottom to 
the top of the screen. Digital data, for example close - 
captioned data, or current time data, is modulated onto the 
carrier signal during the VBI . 

35 The OSDCF 424 includes an analog to digital 

converter (ADC) which digitizes the incoming baseband video 
and extracts digital information transmitted in the VBIs. As 
explained more, fully below, messages for transmission to the 
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database are transmitted in the VBIs, These messages are 
transferred to the processor 4 00 which executes a data base 
engine process to build or update the database. 

The OSD part of the OSDCF 424 includes cache memory, 
character memory, timing functions, and an external RAM. The 
OSD reads high level graphic commands sent from the processor 
4 00 and stores graphic information in the RAM. The OSD 
outputs red (R) , green (G) , blue (B) , graphic data which is 
used to generate a local video signal. Depending on the state 
of the user input interface, described below, the OSD local 
video. .output or the incoming live video will be displayed. 

Accordingly, screen display graphic data generated 
by the database engine is transferred to the RAM of the OSD 
which the generates a local video signal that causes the 
display screen to be displayed on the television screen. 
Scheduling Data Structures 

The database engine (DBE) builds a hierarchical 
database in the RAM. The hierarchical structure of the 
database is depicted in Fig. 4. The database is structured 
internally as schedule data structures and theme data 
structures linked by handles and handle tables. Each handle 
is an index to a handle table which contains pointers to 
blocks of memory where structures of the database are stored. 

The hierarchy for the schedule data structures, in 
descending order, is: 

Channel Data Table: contains subscriber unit's list of 

channels; 

Show List: contains time slots for each show 

scheduled to be broadcast for a 
channel ; 

Show Title: contains the title text and show 

title attributes; 
Show Description: contains show's ratings, attributes, 

and description text. 
A channel data table, depicted in Fig. 5A, is the 
highest data structure in the hierarchy. This table includes 
an entry for each channel received by the subscriber unit • 
The entries in. the channel data table are changed infrequently 
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and are determined by the location of the subscriber unit and 
type of services received. Each channel data table entry 
includes information concerning the channel and a handle to a 
show list handle table for the channel . 

The next data structure in the hierarchy is the show 
list depicted in Fig- 5B. The show list includes a start time 
typically being midnight GMT and 24 hours of scheduling. The 
channel's schedule is given by an ordered sequence of show 
slots, with a show slot for each show to be broadcast by a 
particular channel for a particular day. Each slot includes a 
duration; :"show title handle, and show description handle. 
Finding an entry corresponding to a given start time requires 
the entries to be scanned, in order, from the beginning of 
show list and adding duration values. 

The database, when fully constructed, holds a weeks 
worth of show lists for each channel. The days of the week 
are accessed by incrementing the show list handle by two 
bytes. The show lists are updated each day at midnight GMT 
with the show list for the day just completed being deleted 
and the show list for same day next week being added to the 
database . 

The next data structures in the schedule hierarchy 
are the show title entries, depicted in Fig. 5C and show 
description entries, depicted in Fig. 5D. For a given show 
slot tjie show title entry and show description entry are 
accessed utilizing the handles included in the slot. The show 
title and show description entries are stored in a memory pool 
divided into blocks. Each show title is identified by a 
unique 20x~bit show identification number (SID) and each show 
description is identified by a unique 2 0 -bit number assigned 
at the head end. The show title handles are based on the SID 
and the show title handles are offsets into a show title 
handle table. The entry in the show title table accessed by a 
particular show title handle includes the address of the first 
block in the memory pool where the show title entry is stored. 
Similarly, the show description handle table entry accessed by 
a show description handle stores the address of the first 
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block in the memory pool where the show description entry is 
stored. 

Each show title entry includes theme index ID and 
the text of the show title. Typically, a single show title 
5 entry will be referenced by many show lists for different 

channels, days, and times. Thus, by utilizing handles in the 
show lists all show lists reference a single show title entry 
in memory so that memory is efficiently used. Many show title 
entries have a long life because the show titles may be for 

10 series that are broadcast over long periods of time and may be 
referenced by many showlists since many shows are broadcast by 
multiple channels . 

Each show description entry incudes a theme index 
ID, critics rating, MPAA rating for the show, traits mask 

15 bits, year produced, and show description text. Show 

description entries tend to have a shorter life than show 
title entries because a description is only valid for a 
particular episode of a series. 
User Interface 

20 The user interface takes remote control commands as 

its primary input. In one embodiment a user requests various 
functions by pressing function buttons on a remote control. 
In another embodiment, the GUI is utilized with different 
interactive regions on a displayed screen corresponding to 

25 different functions. The user moves the cursor over the 

interactive region corresponding to a desired function and 
selects the function to generate command. The particular form 
of entering a command is not critical and technology for 
utilizing voice commands may soon be available. 

3 0 The user interface receives commands and responds 

with a requested display screen and by performing the function 
requested by the command. The function performed may be to 
perform an action such as selecting a new viewer guide based 
on the Time Indicator glyphs, accessing a related internet 

35 site, controlling the features of an integrated electronic 
device, or purchasing merchandise. The data and format of 
each screen is dependent on the previous screen, time of day, 
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the contents of the data base, the command received, and other 
parameters- A state table is used to define the screen flow. 

For every defined screen, there is an entrance 
function, an exit function, an update function, and an array 
of request -handling functions. The entrance function is 
called when a state is first entered to collect all necessary 
data and format the screen. The exit function is called to 
release memory and data for the screen. The update function 
is called once per minute to update the screen time and to re- 
draw the screen if any information displayed on the screen 
needs to be updated. 

Once in a particular state, the table contains a 
reference to another software function corresponding to each 
key on the remote control or to each interactive region on the 
screen. These referenced functions will be executed whenever 
an associated remote control button is pressed or interactive 
region is selected. 

For example, if the user wishes to choose a new 
viewer guide, in the GUI embodiment, the viewer moves the 
cursor over the Time Bar interactive region which is then 
selected to request a new time indicator. A confirmation 
screen will then be generated. 

The screens are displayed by the on-- screen display 
(OSD): controller based on graphic display commands issued by 
the database engine. Among the primitive commands needed to 
draw system display screens are the Erase Screen Command; Draw 
Rectangle Command; Save Rectangle Command; Restore Rectangle 
Command; Move Rectangle Commands; Write ASCII String Command; 
and Draw Channel Icon Command. 

Each screen includes areas that are constant and 
based on code and data stored in non-volatile memory and 
variable areas such as show titles and descriptions which 
utilize data stored in the database. Additionally, graphics 
files are also being stored in the database to be displayed in 
windows of the display screen. 
Description of the On- Screen Menuina System 

Referring to Figs. 6-7, the main menu and sub menu 
hierarchy is depicted. Using the interactive capabilities of 
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the on-screen menuing system, the user is able to access a 
variety of linked menus. Fig. 6 depicts a plurality of linked 
menus in which a viewer may navigate using the pointer/cursor 
and the interactive nature of the on-screen menuing system. 
5 Fig. 6 depicts the ability of the user to move from a TV state 
500 to a main menu state 502. The user may also reach any of 
the sub menus, including the program guide 102, TV controls 
guide 504, setup guide 506 and any other menu that may be 
added to the on-screen menuing system. 

10 These menus control the various features of the 

connected electronic devices. The graphical nature of the 
menus is such that the control structure and format is similar 
from menu to menu. This feature allows the user to be 
familiar with the control structure when operating any of the 

15 various integrated electronic devices. e.g., the look and 

feel of the menu that selects the channels to be viewed with 
the television tuner is similar to the menu displayed to 
control the channel to be viewed when using the integrated vcr 
tuner. The familiar nature of the graphical interface allows 

20 for a shorter learning curve of the features of the integrated 
electronic devices when the user initially encounters the on- 
screen menuing system. 

The menuing system is especially useful in a host TV 
system utilizing programmed control of host functions, for 

25 example, basic native host functions such as brightness, 

color, volume and other controls. The present menuing system 
provides an integrated visual systems for controlling both 
native host features as well as program guide features. 
Further, the menuing system provides a common interface for 

3 0 other programs which can be resident on the host processor. 

Accordingly, the present system provides a common 
interface and is thus portable from system to system. 

Referring now to Fig. 7A, an embodiment of the 
structure of the menuing system is depicted schematically. 

35 Fig. 7A depicts the top level functions. The user can advance 
to any top-level application by moving the pointer to the 
option on the menu and selecting the option. The STARSIGHT 
option is bolded in this embodiment which indicates the 
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pointer will automatically be positioned over this option when 

the menu first appears. 

Each menu option may lead to any number of further 

sub-menus, so that a particular option may be buried as many 
5 levels deep as appropriate. For example, a user who selects 

the TV control 504 application can see a series of menus as 

shown in Fig- 7B. 

Figs. 7B-7C depict several host functions. The TV 

control menu 504 is shown. A user can interactively control 
10 the various picture controls by maneuvering the pointer/cursor 

and selecting a specific control to adjust. For example. Fig. 

7B depicts the contrast, brightness, color, tint, and 

sharpness controls of a television. Any number of television 

controls may be added to the on-screen menuing system . 
15 Further, as described above, since the present 

menuing system provides a consistent interface to all 

programs, selecting an application works the same way for EPG 

applications, host applications, and third party applications. 

An example of such an application is depicted in Fig. 7D where 

2 0 a communication program is controlled by the on-screen menuing 

system interface. 

Fig. 7E depicts several sub level command functions 
of the comlink menu 512 . This figure illustrates how the 
display of the on-screen menuing system is similar for all of 
25 the integrated electronic devices , 

Fig. 7F depicts a host command function for the 
comlink sub-menu. Here, the incoming command 514 is executed 
by the user by positioning the pointer/cursor above a selected 
interactive glyph . 

3 0 Description of the Current Time Display 

Referring to Fig. 8, the current time and the 
passage of time is displayed for the viewer using the program 
guide 102.. A current time and time remaining bar 6 00 is 
depicted on the program matrix 108 . In a preferred 
35 embodiment, the current time and time remaining bar 500 will 
be indicated to the viewer on the left side of the program 
matrix 108, for example, by changing the background color of 
the current time and time remaining bar area from one color to 
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a slightly darker color. This darkening of the current time 
and time remaining bar area is depicted as a vertical bar that 
sweeps across the display area from left to right. The 
current time and time remaining bar also grows in width as 
5 time progresses, in a manner that depicts both the current 
time, the passage of time and the time remaining for any 
particular program currently displayed on the program matrix 
108. The viewer is thereby able to easily determine the time 
remaining and when the next program on a specific channel will 
10 begin. 

The current time is maintained in the data 
structure. The processor reads the current time data and the 
EPG display controller displays the current time and time 
remaining bar information on the program guide 102. 

15 Periodically the current time is reread by the processor and 
the newer grid guide is redisplayed - 
Description of Time Bar Glyph 

The time bar 704 allows the user to interactively 
choose a desired time frame to be viewed. As can be seen in 

20 figure 1, in a first configuration, the time glyph 602 is an 

interactive area of the program guide 102. In this state, the 
time glyph depicts the current time frame displayed on the 
program guide 102. However, as can be seen in Fig. 9, when a 
user moves the pointer/ cursor 110 over the time glyph 602, the 

25 glyph iimmediately becomes the time bar glyph 704. The time 
bar glyph depicts a longer span of time. In a preferred 
embodiment, this longer span of time is 12 hours. The longer 
span of time indicates an interactive area in which the user 
may choose a specific time frame to be displayed on the viewer 

30 grid guide. The time bar glyph 704 includes a series of time 
indicator glyphs 706. If any of these glyphs are chosen by 
the user by positioning the pointer and then activating the 
chosen glyph, the EPG grid guide will display the viewer guide 
associated with the chosen time indicator glyph. 

35 This interactive nature of the time bar 704 allows 

the user to quickly and easily display any desired future time 
span of the program guide 102. 



BNSDOCID; <WO 983883 1A1_L> 



wo 98/38831 PCT/US98/03958 

19 

Description of the Morphina Pointer/Cursor 

As can be seen in figure 1, the pointer/cursor 110 
normally appears as an arrow or triangle. The tip of the 
pointer /cursor 110 indicates the interactive area of the EPG 
5 to be chosen. 

However, referring to Fig, lOA or lOB, when a user moves 
the pointer /cursor 110 to the edge of the program matrix 108, 
the configuration of the pointer/cursor 110 changes to 
indicate to the user alternate or additional information. 

10 Fig. lOA shows that the cursor has changed into an icon that 
represents that the program matrix 108 may be shifted by an 
entire page. Alternatively, the pointer/cursor in this 
changed configuration, may perform some other command when 
activated. In addition, depending on the location of the 

15 pointer /cursor, the shape of the pointer /cursor may change and 
an additional informational window may appear. These 
additional informational windows 512 are designed to fade from 
view when the information provided is no longer necessary for 
the user or following a predetermined period of time, or a 

20 predetermined set of commands has been issued buy the user. 

Fig. IOC depicts a program guide 102, and an 
additional configuration for a pointer/cursor without the 
additional informational window 512. 
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WHAT IS CLAIMED IS: 

1. A system for displaying information on an EPG 
screen comprising: 

an EPG display controller that processes display 
5 data to display an EPG display; 

a memory for storing an EPG database containing 
display data, and program data; 

a processor, coupled to the memory, and the EPG 
display controller, with processor configured to process: 
10 database engine program data to execute a 

database engine that generates EPG screen data; and 

display data that includes current time data, 
wherein said current time data includes data for 
causing said EPG display controller to display an 
15 EPG display of the viewer grid guide, wherein the 

current time data is depicted as displaying a 
portion of the viewer grid guide in shadow. 

2 . The system of claim 1 wherein EPG display 

20 controller displays the current time data, and time remaining 
data as a transparent overlying shadow that proceeds across 
the screen from left to right, graphically depicting the 
current time data and time remaining data. 

25 ^ 3. A system for directly invoking actions from 

interactive areas of an EPG displayed on a screen comprising: 
an EPG display controller that processes display 
data to display an EPG display, and including interactive 
areas, and displaying a pointer/cursor on the screen, 
30 with the interactive areas configured to invoke EPG 

actions, associated with interactive areas, when the 
interactive areas are selected by a viewer; 

a memory for storing an EPG database containing 
display data and program data; 
35 an input module that receives user pointer/ cursor 

movement commands ; 
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a processor, coupled to the memory, the input 
module, and the EPG display controller, with processor 
configured to process: 

database engine program data to execute a 
5 database engine that generates EPG screen data; 

user interface program data to execute a user 
interface that user pointer/cursor movement 
commands, and generates response screens, with the 
user interface responsive to movement of the 
10 pointer/cursor over an interactive area to change 

the configuration of the display of the 
pointer/cursor to display alternate or additional 
information. 

15 . 4 . The system of claim 9 wherein the display of 

the pointer/cursor varies to include an info screen and 
provide additional information upon being positioned in a 
predetermined location of the EPG display screen. 

20 5. A system for directly invoking actions from 

interactive areas of an EPG displayed on a screen comprising: 
an EPG display controller that processes display 
data to display an EPG display, and including interactive 
areas, and displaying a pointer/cursor on the screen, 
25 with the interactive areas configured to invoke EPG 

actions, associated with interactive areas, when the 
interactive areas are selected by a viewer; 

a memory for storing an EPG database containing 
display data, where said display data includes program 
3 0 data; 

an input module that receives user pointer/cursor 
movement commands ; 

a processor, coupled to the memory, the input 
module, and the EPG display controller, with processor 
35 configured to process: 

database engine program data to execute a 
database engine that generates EPG screen data; 
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user interface program data to execute a user 
interface that user pointer/cursor movement 
commands, and generates response screens; and 
display data, wherein said display data 
5 includes data for causing said EPG display 

controller to display an EPG display including 
interactive areas in the forms of glyphs, wherein a 
first glyph is a guide time glyph that changes into 
a guide time bar glyph when activated, with said 

10 time bar glyph including a series of time indicator 

glyphs, with said user interface for generating 
display data listing future times available for the 
display of the EPG when said guide time bar glyph is 
activated and for generating a grid of channels and 

15 programs for a specific span of time when a specific 

time indicator glyph is activated, and where said 
program data includes data for causing said user 
interface to recursively vary the configuration of 
the EPG display when the viewer activates the 

2 0 glyphs - 

6. An on-screen menuing system for directly 
invoking actions from interactive areas of an EPG displayed on 
a screen comprising: 
25 an EPG display controller that processes display 

data to display an EPG display, and including interactive 
areas, and displaying a pointer /cursor on the screen, 
with the interactive areas configured to invoke EPG 
actions, associated with interactive areas, when the 

3 0 interactive areas are selected by a viewer; 

a memory for storing an EPG database containing 
display data, where said display data includes program 
data; 

an input module that receives user pointer/cursor 
35 movement commands; 

a processor, coupled to the memory, the input 
module, anci the EPG display controller, with processor 
configured to process: 

V 
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database engine program data to execute a 
database engine that generates EPG screen data 
including: 

a main menu; 

at least one sub menu; and 
at least one host function that includes 
commands for controlling a plurality of connected 
electronic devices each configured to accept and 
perform the commands. 

7, A method of operating an on screen menu system 
for controlling integrated electronic devices compri3ing the 
steps of at least one of either: 

using an EPG display controller to display either a 
main menu, at least one sub menu or at least one host 
function that includes commands for controlling a_ 
plurality of connected electronic devices each configured 
to accept and perform the commands; 

selecting either a main menu, a sub menu or a host 
function that includes commands for controlling a 
plurality of connected electronic devices each configured 
to accept and perform the commands; and 

having the connected electronic devices accept and 
^perform the selected host function commands. 
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TELEVISION CONTROL INTERFACE WITH ELECTRONIC GUIDE 

BACKGROUND OF THE INVENTION 

This patent application is related to a U.S. 
Provisional patent application entitled "Seamless Television 
Control Interface w-ith Electronic Guide," U.S. Application No. 
60/039,278, which was filed on February 28, 1997, of Alba et 
al . , the disclosure of which is incorporated by reference for 
all purposes. 

The present invention generally relates to 
television schedule information, and more particularly to a 
system and method for displaying a television program guide on 
a television screen. 

As the number of television stations in a 
metropolitan area or on a cable network has increased, the 
number of programs of potential interest that are presented to 
a viewer has risen dramatically. With the use of dish 
antennas capable of receiving direct satellite signals, the 
multitude of programs available to the viewer has further 
increased. 

Additionally, television faces a digital future that 
will se.e the merger of television and PC technology. The 
television set of the future will include a micro -computer, a 
modem of interconnect ivity with other computers over networks, 
intranets, and the internet, and be connectable to computer 
peripherals such as printers. Such capabilities as near 
"video on demand" (NVOD) , "video on demand" , access to the 
world wide web", "audio on demand", etc. will be present the 
viewer with a plethora of information and bandwidth. In 
addition to PC capabilities, viewers will want to control 
other consumer electronic devices such as VCR's and surround 
sound receivers . 

As has become increasingly evident, information 
overload can actually reduce the usefulness of the information 
delivered. Accordingly, a great challenge exists to provide 
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an interface that manages and provides an intelligent, user- 
friendly interface to the information available. 

Consequently, television schedule systems or 
electronic program guides (EPG) that are provided directly on 
5 the viewer's television screen have been developed to assist 
the viewer in sorting through these various programs and 
determining which programs to watch or record. One such 
television schedule system is disclosed in commonly assigned 
U.S. Patent No. 5,353,121 (Young et al . ) , the complete 

10 disclosure of which is hereby incorporated by reference . In 
one embodiment of Young, the television schedule includes a 
series of menu screens having an array of cells corresponding 
to different television programs. The viewer may scroll 
through the cells to view which television programs are being 

15 presented on various channels at various times. In addition, 
the viewer may select certain cells to obtain more information 
on the associated program or to pull up other sub-menus with 
additional options. 

The recent development of television schedule 

20 systems, such as the above described patent to Young, have 

created many new challenges. One such challenge is to manage 
intelligently the vast stores of information available and 
provide user access and control directly through an electronic 
program guide- Another challenge is to facilitate easy access 

25 to a wi-de range of functionality through the combination of a 
limited number of user interactions. And still another 
challenge is to control several differing integrated 
electronic devices with the same ease of use incorporated into 
each. 

3 0 SUMMARY OF THE INVENTION 

The present invention provides a system and method 
of accessing a series of menus for controlling a variety of 
integrated electronic devices and for displaying schedule 
information on a visual interface, such as a television 
35 screen, a computer monitor or the like. An integrated 

electronic device is any device that has been configured to 
accept and perfprm the commands of the on-screen menuing 
system. The present invention also provides a system and 
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method for allowing the viewer to navigate and interact with a 
program guide that is displayed, for example, on the viewer's 
television screen. The program guide will usually include a 
schedule information area that depicts the programs that are 
5 being presented on each channel at each time during the day. 
With an input device, such as a remote control device, 
pointing device, mouse, keyboard, microphone or the like, the 
viewer can browse through the schedule information area and/or 
obtain more information about programs of . particular interest. 

10 According to one aspect of the invention, actions 

are directly invoked by moving, a pointer over areas of the 
visual interface and selecting or "clicking" on the area. 

In one aspect of the invention, a system and method 
is provided for allowing the viewer to utilize display action 

15 controls, configured as glyphs, to recursively vary the 

configuration of the display area. Each glyph is activated by 
a point and click action of the user input device and serves 
as a switch for changing between two modes . 

According to one aspect of the invention, a system 

20 and method is provided for accessing a series of menus and 

host functions that control a variety of integrated consumer 
electronic devices. 

According to one aspect of the invention, a system 
and method is provided for allowing the user to easily change 

25 the titt^^ frame displayed on the EPG guide, and the 

accompanying viewer guide by activating the time bar glyph and 
then activating a specific time indicator glyph. 

According to one aspect of the invention, a system 
and method is provided for changing the configuration of the 

3 0 pointer /cursor to provide the user with additional or 

alternate information. The pointer/cursor changes depending 
on the location of the pointer/cursor on the EPG display 
guide . 

According to one aspect of the invention, a system 
35 and method is provided for graphically depicting the current 
time and the show time remaining by displaying a transparent 
shadow that proceeds across the EPG screen from left to right; 
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Other features and advantages of the invention will 
be apparent in view of the following detailed description and 
the appended drawings . 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a representation of an embodiment of the 
EPG display of the present invention. 

Fig. 2 is a block diagram of a TV system. 

Fig. 3 is a block diagram of a hardware unit for 
10 generating an on-screen electronic programming guide (EPG) . 

Fig. 4 is a schematic diagram of the hierarchical 
database utilized to generate the EPG. 

Figs. 5A-5D are schematic diagrams of data 
structures in the database. 
15 Fig. 6 is a flow diagram of a menuing hierarchy. 

Fig. 7A is a screen depiction of a series of sub- 
menus • 

Fig. 7B-7C are screen depictions of a series of host 
function commands . 
20 Fig. 7D-7E are screen depictions of a series of sub- 

menus . 

Fig. 7F is a screen depiction of a series of host 
function commands. 

Fig, 8 is a screen depiction of the current time 
25 data depicted as a darkened area on the EPG screen. 

Fig. 9 is a screen depiction of the Time Bar glyph 
which includes a series of Time Indicator glyphs . 

Fig. lOA-lOC are screen depictions of the 
pointer/cursor which depicts alternate or additional 
3 0 information . 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
Overview of the Interactive Screen 

The present invention provides an on-screen menuing 
system and method for controlling several integrated consumer 
35 electronic devices and a schedule system and method for 

displaying schedule information on a visual interface, such as 
a television screen, computer monitor or the like. The system 
and method is particularly useful for use with television 

V 
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schedule information. The television schedule information is 
presented in a program guide having a schedule information 
area depicting the program that is being shown on each channel 
for a period of time, e.g., a day, week or longer. 
Additionally, the EPG displays the controls of functions for 
various integrated electronic devices in a series of menus . 

The on-screen menuing system provides a series of 
interactive menus. These interactive menus include commands 
to control the functions of the connected electronic devices 
that are configured to accept and perform the commands of the 
on-screen menuing system. 

The on-screen menu system and method for controlling 
several connected electronic devices and television schedule 
system include an input device, such as a remote control 
device, pointing device, mouse, keyboard, microphone or the 
like, to allow the user to browse through the menu or schedule 
information area, obtain more information about programs of 
particular interest and control various features of the 
integrated electronics . 

The controller may comprise a trackball, cursor 
controller, pointing device, a microphone for allowing voice 
activation, a number of keys or buttons that function to move 
the viewer around the screen, or the like. In the preferred 
embodiment, the controller comprises a scrolling mechanism for 
displacing a movable cursor through a matrix of cells or 
windows on the screen. The cursor may comprise a physical 
icon on the screen, or it may be represented by highlighting 
or other visual indications of the cells or windows that are 
scrolled through by the viewer. 

Figure 1 illustrates a program guide 102 for the 
television schedule system of the present invention. The 
program guide 102, which is the primary mode in the television 
schedule system, includes a number of screen information areas 
or windows in a particular screen where the viewer operates an 
input device, such as a pointer device described above, to 
move around vertically and horizontally and to interact with 
that screen area's function. Preferably, the currently active 
screen area will be indicated to the viewer, for example, by 
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changing the background color from a light greyscale metallic 
to a brighter, active color. Within each screen area are one 
or more items, typically arranged in a matrix or grid so that 
the viewer can scroll through the grid. The items can be 
selected or activated with the input device. 

As shown in Fig. 1, program guide 102 preferably 
includes a schedule information area 106 having a program 
matrix 108 of cells or items that depict the shows that are 
being presented on each channel at each time during the day. 
Program guide 102 conveniently lists the channels in a 
vertical column to the left of the program matrix 108 and the 
times in a time bar 602 in a horizontal row above matrix 108. 
The viewer selects an area by moving a pointer 110 over the 
area associated with a desired action. When the pointer 110 
is moved over an area, the item may be automatically 
highlighted with a brighter color to indicate the viewer's 
location. 

In Fig. 1, program guide 102 includes a number of 
other information areas. For example, program guide 102 
includes a display title area 200 that includes a display mode 
icon 202 and a display mode description text field 204, An 
interactive data control window 206 displays the date for the 
listings in display matrix 108. 

Directly below the display area 108 are four small 
action controls 208-211 which give the viewer the ability to 
recursively vary the configuration of the display area 108. 
The operation and functions of these action controls is 
described in detail below. A world icon 214 may appear below 
the display area on the left side and a star (linked services 
available) icon 216 may appear directly below the display area 
on the right side . 

A video window 22 0 may display a currently- tuned 
television show. Below the video window 220 is a channel 
window 222, a title window 224, and a current time display 
window 226. Each of these windows are interactive. 
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Overview of an EPG System 

A detailed description of The EPG system, may be 
found in U.S. patent application no. 08/906,073 and so is 
herein incorporated by reference for all purposes. 

In a preferred embodiment, the electronic program 
guide of the invention may be implemented either on a personal 
computer, a PCTV, a television connected to a set-top box, or 
a television including a custom board. However, the invention 
is not limited to any particular hardware configuration and 
will have increased utility as new combinations of computers 
and television systems are developed- In the following any of 
the above will sometimes be referred to as a "TV system" . 
Block diagrams of representative TV systems are depicted in 
Fig. 2. Details of implementation are not depicted because 
the invention is not limited to any particular TV system. 

As is well known, the picture to be displayed may be 
transmitted as an analog signal, for example according to the 
NTSC standard utilized in the United States, or as a digital 
signal modulated onto an analog carrier. The signals may be 
received over a cable, or via an antenna or satellite dish. 
Typically, television sets are designed to receive analog 
signals and computers display devices are designed to display 
pictures encoded in a digital format. However, decoder system 
converts the digital data to an analog signal for display on a 
television set and TV modems can format analog TV signals for 
display on a monitor. 

In Fig. 2, analog or digital TV signals, received 
via cable 330, antenna 332, or satellite dish 334, are 
provided to a television system. If the signal is from a 
digital broadcast service, then a decoder 33 6 converts the 
signal to baseband video and audio or channel 3/4 RF. If the 
signal is an analog signal it is passed through as a video 
output. The television system 338, depending on its 
configuration, receives selected ones of the outputs and 
displays the received program. 

A PCTV includes a TV card 340, connected to either 
live video, baseband video, or channel 3/4 output, digitizes 
the video image \a.nd displays the video image in a resizable 
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window on the computer monitor. The PCTV is also coupled to 
land telephone lines by a modem 342. 

If the received signal is an analog TV signal the TV 
card of the PCTV digitizes the analog signal and extracts 
5 included information from the vertical blanking intervals 

(VBI) . On the other hand, if the signal is a digital signal 
separate audio, video, VBI (vertical blanking information such 
as closed caption, teletext, current time data and program 
related information) , program guide, and conditional access 
10 information are provided as separate bit streams . The video 
and audio bit streams fot programs are converted to a format 
for display and the program guide information is processed to 
form program guide database. The processor, executing 
software stored in memory, generates interactive electronic 
15 program guide images and images of received programs. The 
guide can be used to interact with and control programs _ 
displayed in the window. 

A television system configured to display an 
electronic program guide such as a guide provided by StarSight 
20 telecast includes an on-screen display controller and other 
hardware described below. If a standard analog broadcast 
signal is received program guide data, including current time 
data, is extracted from the VBI by a VBI data slicer and 
processed to form a program database. If a DBS digital signal 
•25 is received, either from a satellite or cable, VBI and program 
data, including current time data, are provided in separate 
bit streams. The program guide images are. generated are 
either generated locally or remotely and provided to an on 
screen display controller. Interactivity is provided via a 

30 remote control. 

Alternatively, the program guide can be displayed on 
a computer monitor that interactively controls the television 
set through, for example, an IR interface including an IR 
blaster 344 to generate IR codes to control a television, a 

35 VCR and/or any other connected electronic device configured to 
accept and perform the commands of the on-screen menuing 
system. 
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If the electronic guide database is generated 
locally the system for creating the electronic programming 
guide must receive television schedule information and process 
the received information to create a database. Thus, the 
system requires, a data reception unit, a processor, memory to 
store program code and a database, an on-screen display 
generator (OSD) , and a control interface for tuning to 
selected channels. 

In one preferred embodiment, the schedule 
information is transmitted as a set of short commands of 
specified formats. Different commands communicate information 
such as a show schedule for a given channel, the title of each 
show in the schedule, descriptions and information attributes 
about each show in the channel. Thus, information for a show 
to be broadcast at a particular time is transmitted in several 
commands. ID numbers in the commands facilitate organizing 
the information into a relational database utilizing database 
engine (DBE) software stored in memory and executed by the 
processor • 

In a preferred embodiment, a board is included at a 
viewer's television set and the database is stored locally and 
commands are transmitted in the vertical blaxiking intervals 
(VBI) of programming on a designated channel, for example PBS. 
An example of a board for receiving program guide information, 
generating program guide database, displaying the program 
guide, and interactively controlling the program guide is 
depicted in Fig. 3. The commands are transmitted to the board 
in the vertical blanking intervals of programming broadcast on 
a designated channel. 

Alternatively, the commands could be transmitted to 
the local unit over land telephone lines. Additionally, as 
described below, in some systems the database is built 
remotely and the guide itself is transmitted to the local 
unit . 

The database engine builds a hierarchical database 
in the RAM. The hierarchical structure of the database is 
depicted in Fig> 4. The database is structured internally as 
schedule data structures and theme data structures linked by 
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handles and handle tables. Each handle is an index to a 
handle table which contains pointers to blocks of memory where 
items of the database are stored. 

In another embodiment, for example a DSS system, 
program guide data is transmitted as a bit stream that is 
processed by the database engine. 

Additionally, a N.E.W.S. (new, entertainment, 
weather, and sports) database has been developed. Commands 
including stoiry text and story IDs are transmitteci. Links 
from the program guide to stories related to a program can be 
created and the related stories can be accessed from the 
guide . 

An advertisement database is also created from 
commands including advertising text and logos including IDs 
for linking the ads to shows displayed in the EPG. The user 
may access the advertising information directly from the 
guide . 

An internet database is also created from commands 
including URLs to internet sites related to programs displayed 
on the EPG. If the viewer is viewing the EPG on a platform 
that is Web enabled, e.g., WebTV, a PC, or PCTV, then a linked 
site can be accessed directly from the EPG. 

Additionally, a graphics program module builds 
various displays utilizing schedule, show title, and other 
information from the database. If the OSD controller operates 
in the character mode the display is a grid of character codes 
which are transferred to the on-screen display (OSD) 
controller which generates the on-screen display. 

An input -response user interface program module 
responds to user input to generate new displays responsive to 
the particular input. In one preferred embodiment, the user 
utilizes an input device, e.g., a remote control, mouse, or 
keyboard, to place a pointer over a part of the current 
display and clicks. The input -response module responds to the 
position of the pointer and the particular display currently 
displayed to generate a responsive display or take a 
particular action. In another preferred embodiment the user 
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interface responds to function buttons on a remote control. 
Specific examples will be described below. 
Board Description 

Fig. 3 is a block diagram embodiment of the 
electronic hardware unit 452 utilized to perform the 
electronic on-screen schedule display and other functions. 
The particular hardware unit 452 depicted is for TVRO (TV 
Receive Only) customers having home satellite dishes for 
television viewing. This unit is coupled in series with 
existing customer TVRO equipment . 

In Fig. 3, the unit receives Baseband Video in 423 
from the customer TVRO system. The unit optionally outputs 
Baseband Video out 428 or channel 3/4 RF out 430. The unit 
includes an 8 -bit microprocessor 400, 64 bytes of code ROM 
401, 512 K of RAM 402 for program data storage, a custom gate 
array 403, segmented base registers 404 for fast memory data 
manipulation, security logic 4 06 for decoding incoming 
encrypted data, a serial bus 408 for display controller 
interface, serial bus 410 for inter -processor communication, 
watchdog timer 412 for error recovery, IR input 413, IR 
transmitter circuits 416 for TV, VCR control, IR output 417, 
CRC-32 encoding and decoding logic 418, on-board power supply 
420, video input 423, On-Screen Display Controller and 
Formatter 424, custom color converter 426, RF modulator 427, 
choice of Baseband Video or RF outputs 428 or 430. 

The on-screen display controller and formatter 
(OSDCF) 424 functions as an I/O controller, an on-screen 
display controller (OSD) , and also as a closed- caption data 
(CCD) VBI data slicer. The VBI (vertical blanking interval) 
is a dead space in a TV signal that allows a television signal 
to reposition the scanning electron beam from the bottom to 
the top of the screen. Digital data, for example close - 
captioned data, or current time data, is modulated onto the 
carrier signal during the VBI. 

The OSDCF 424 includes an analog to digital 
converter (ADC) which digitizes the incoming baseband video 
and extracts digital information transmitted in the VBIs. As 
explained more fully below, messages for transmission to the 
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database are transmitted in the VBIs. These messages are 
transferred to the processor 400 which executes a data base 
engine process to build or update the database. 

The OSD part of the OSDCF 424 includes cache memory, 
character memory, timing functions, and an external RAM. The 
OSD reads high level graphic commands sent from the processor 
4 00 and stores graphic information in the RAM. The OSD 
outputs red (R) , green (G) , blue (B) , graphic data which is 
used to generate a local video signal . Depending on the state 
of the user input interface, described below, the OSD local 
video output or the incoming live video will be displayed. 

Accordingly, screen display graphic data generated 
by the database engine is transferred to the RAM of the OSD 
which the generates a local video signal that causes the 
display screen to be displayed on the television screen. 
Scheduling Data Structures 

The database engine (DBE) builds a hierarchical 
database in the RAM. The hierarchical structure of the 
database is depicted in Fig. 4. The database is structured 
internally as schedule data staructures and theme data 
structures linked by handles and handle .tables . Each handle 
is an index to a handle table which contains pointers to 
blocks of memory where structures of the database are stored. 

The hierarchy for the schedule data stmctures, in 
descending order, is: 

Channel Data Table: contains subscriber unit's list of 

channels; 

Show List: contains time slots for each show 

scheduled to be broadcast for a. 
channel ; 

Show Title: contains the title text and show 

title attributes; 
Show Description: contains show's ratings, attributes, 

and description text. 
A channel data table, depicted in Fig. 5A, is the 
highest data structure in the hierarchy. This table includes 
an entry for each channel received by the subscriber unit. 
The entries in the channel data table are changed infrequently 
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and are determined by the location of the subscriber unit and 
type of seorvices received. Each channel data table entry 
includes information concerning the channel and a handle to a 
show list handle table for the channel . 
5 The next data structure in the hierarchy is the show 

list depicted in Fig. 5B. The show list includes a start time 
typically being midnight GMT and 24 hourq of scheduling. The 
channel's schedule is given by an ordered sequence of show 
slots / wibh. ja show slot for each show to be broadcast by a 

10 particular channel for a particular day. Each slot includes a 
duration, show title handle, and show description handle. 
Finding an entry corresponding to a given start time requires 
the entries to be scanned, in order, from the beginning of 
show list and adding duration values . 

15 The database, when fully constructed, holds a weeks 

worth of show lists for each channel . The days of the week 
are accessed by incrementing the show list handle by two 
bytes. The show lists are updated each day at midnight GMT 
with the show list for the day just completed being deleted 

20 and the show list for same day next week being added to the 
database. . - 

The next data structures in the schedule hierarchy 
are the show title entries, depicted in Fig. 5C and show 
description entries, depicted in Fig. 5D. For a given show 

25 slot th^ show title entry and show description entry are 

accessed utilizing the handles included in the slot. The show 
title and show description entries are stored in a memory pool 
divided into blocks. Each show title is identified by a 
unique 20 -bit show identification number (SID) and each show 

30 description is identified by a unique 20 -bit number assigned 
at the head end. The show title handles are based on the SID 
and the show title handles are offsets into a show title 
handle table. The entry in the show title table accessed by a 
particular show title handle includes the address of the first 

35 block in the memory pool where the show title entry is stored. 

Similarly, the show description handle table entry accessed by 
a show description handle stores the address of the first 
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block in the memory pool where the show description entry is 
stored • 

Each show title entry includes theme index ID and 
the text of the show title. Typically, a single show title 
entry will be referenced by many show lists for different 
channels, days, and times. Thus, by utilizing handles in the 
show lists all show lists reference a single show title entry 
in memory so that memory is efficiently used. Many show title 
entries have a long life because the show titles may be for 
series that are broadcast over long periods of time and may be 
referenced by many showlists since many shows are broadcast by 
multiple channels . 

Each show description entry incudes a theme index 
ID, critics rating, MPAA rating for the show, traits mask 
bits, year produced, and show description text. Show 
description entries tend to have a shorter life than show 
title entries because a description is only valid for a 
particular episode of a series. 
User Interface 

The user interface takes remote control commands as 
its primary input. In one embodiment a user requests various 
functions by pressing function buttons on a remote control - 
In another embodiment, the GUI is utilized with different 
interactive regions on a displayed screen corresponding to 
different functions. The user moves the cursor over the 
interactive region corresponding to a desired function and 
selects the function to generate command. The particular form 
of entering a command is not critical and technology for 
utilizing vqice commands may soon be available. 

The user interface receives commands and responds 
with a requested display screen and by performing the function 
requested by the command. The function performed may be to 
perform an action such as selecting a new viewer guide based 
on the Time Indicator glyphs, accessing a related internet 
site, controlling the features of an integrated electronic 
device, or purchasing merchandise. The data and format of 
each screen is dependent on the previous screen, time of day. 
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the contents of the data base, the command received, and other 
parameters. A state table is used to define the screen flow. 

For every defined screen, there is an entrance 
function, an exit function, an update function, and an array 
of request -handling functions. The entrance function is 
called when a state is first entered to collect all necessary 
data and format the screen. The exit function is called to 
release memory and data for the screen. The update function 
is called once per minute to update the screen; time and to re- 
draw the screen if any information displayed on the screen 
needs to be updated . 

Once in a particular state, the table contains a 
reference to another software function corresponding to each 
key on the remote control or to each interactive region on the 
screen. These referenced functions will be executed whenever 
an associated remote control button is pressed or interactive 
region is selected. 

For example, if the user wishes to choose a new 
viewer guide, in the GUI embodiment, the viewer moves the 
cursor over the Time Bar interactive region which is then 
selected to request a new time indicator. A confirmation 
screen will then be generated. 

The screens are displayed by the on-screen display 
(OSD) controller based on graphic display commands issued by 
the datkbase engine. Among the primitive commands needed to 
draw system display screens are the Erase Screen Command; Draw 
Rectangle Command; Save Rectangle Command; Restore Rectangle 
Command; Move Rectangle Commands; Write ASCII String Command; 
and Draw Channel Icon Command. 

Each screen includes areas that are constant and 
based on code and data stored in non-volatile memory and 
variable areas such as show titles and descriptions which 
utilize data stored in the database. Additionally, graphics 
files are also being stored in the database to be displayed in 
windows of the display screen. 
Description of the On- Screen Menuina System 

Referring to Figs. 6-7, the main menu and sub menu 
hierarchy is depicted. Using the interactive capabilities of 
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the on-screen menuing system, the user is able to access a 
variety of linked menus. Fig. 6 depicts a plurality of linked 
menus in which a viewer may navigate using the pointer/cursor 
and the interactive nature of the on-screen menuing system. 
5 Fig. 6 depicts the ability of the user to move from a TV state 
500 to a main menu state 502. The user may also reach any of 
the sub menus, including the program guide 102, TV controls 
guide 504, setup guide 506 and any other menu that may be 
added to the on-screen menuing system. 
10 These menus control the various features of the 

connected electronic devices. The' graphical nature of the 
menus is such that the control structure and format is similar 
from menu to menu. This feature allows the user to be 
familiar with the control structure when operating any of the 
15 various integrated electronic devices. e.g., the look and 

feel of the menu that selects the channels to be viewed with 
the television tuner is similar to the menu displayed to 
control the channel to be viewed when using the integrated vcr 
tuner. The familiar nature of the graphical interface allows 
20 for a shorter learning curve of the features of the integrated 
electronic devices when the user initially encounters the on- 
screen menuing system. 

The menuing system is especially useful in a host TV 
system utilizing programmed control of host functions, for 
25 example;, basic native host functions such as brightness, 

color, volume and other controls. The present menuing system 
provides an integrated visual systems for controlling both 
native host features as well as program guide features. 
Further, the menuing system provides a common interface for 
3 0 other programs which can be resident on the host processor. 

Accordingly, the present system provides a common 
interface and is thus portable from system to system. 

Referring now to Fig. 7A, an embodiment of the 
structure of the menuing system is depicted schematically. 
35 Fig. 7A depicts the top level functions. The user can advance 
to any top-level application by moving the pointer to the 
option on the menu and selecting the option. The STARSIGHT 
option is bolded in this embodiment which indicates the 

V 
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pointer will automatically be positioned over this option when 
the menu first appears. 

Each menu option may lead to any number of further> 
sub-menus, so that a particular option may be buried as many 
5 levels deep as appropriate. For example, a user who selects 
the TV control 504 application can see a series of menus as 
shown in Fig. 7B. 

Figs. 7B-7C depict several host functions. The TV 
control menu 504 is shown. A user can interactively control 

10 the various picture controls by maneuvering the pointer /cursor 
and selecting a specific control to adjust. For example. Fig. 
7B depicts the contrast, brightness, color, tint, and 
sharpness controls of a television. Any number of television 
controls may be added to the on-screen menuing system. 

15 Further, as described above, since the present 

menuing system provides a consistent interface to all 
programs, selecting an application works the same way for EPG 
applications, host applications, and third party applications. 
An example of such an application is depicted in Fig. 7D where 

20 a communication program is controlled by the on-screen menuing 
system interface. 

Fig. 7E depicts several sub level command functions 
of the comlink menu 512. This figure illustrates how the 
display of the on-screen menuing system is similar for all of 

25 the integrated electronic devices. 

Fig. 7F depicts a host command function for the 
comlink sub-menu. Here, the incoming command 514 is executed 
by the user by positioning the pointer/cursor above a selected 
interactive glyph. 

3 0 Description of the Current Time Disolav 

Referring to Fig. 8, the current time and the 
passage of time is displayed for the viewer using the program 
guide 102. A current time and time remaining bar 600 is 
depicted- on the program matrix 108. In a preferred 

35 embodiment, the current time and time remaining bar 500 will 
be indicated to the viewer on the left side of the program 
matrix 108, for example, by changing the background color of 
the current time and time remaining bar area from one color to 
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a slightly darker color. This darkening of the current time 
and time remaining bar area is depicted as a vertical bar that 
sweeps across the display area from left to right. The 
current time and time remaining bar also grows in width as 
5 time progresses, in a manner that depicts both the current 
time, the passage of time and the time remaining for any 
particular program currently displayed on the program matrix 
108,. . The viewer is thereby able to easily determine the time 
remaining and when the next program on a specific channel will 
10 begin. 

The current time is maintained in the data 
structure. The processor reads the current time data and the 
EPG display controller displays the current time and time 
remaining bar information on the program guide 102. 

15 Periodically the current time is reread by the processor and 
the newer grid guide is redisplayed. 
Description of Time Bar Glyph 

The time bar 704 allows the user to interactively 
choose a desired time frame to be viewed. As can be seen in 

20 figure 1, in a first configuration, the time glyph 602 is an 

interactive area of the program guide 102. In this state, the 
time glyph depicts the current time frame displayed on the 
program guide 102. However, as can be seen in Fig. 9, when a 
user moves the pointer/cursor 110 over the time glyph 602, the 

25 glyph immediately becomes the time bar glyph 704. The time 
bar glyph depicts a longer span of time. In a preferred 
embodiment, this longer span of time is 12 hours. The longer 
span of time indicates an interactive area in which the user 
may choose a specific time frame to be displayed on the viewer 

30 grid guide. The time bar glyph 704 includes a series of time 
indicator glyphs 706. If any of these glyphs are chosen by 
the user by positioning the pointer and then activating the 
chosen glyph, the EPG grid guide will display the viewer guide 
associated with the chosen time indicator glyph. 

35 This interactive nature of the time bar 704 allows 

the user to quickly and easily display any desired future time 
span of the prog^ram guide 102. 
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Description of the Moriphina Pointer/Cursor 

As can be seen in figure 1, the pointer/cursor 110 
normally appears as an arrow or triangle . The tip of the 
pointer/cursor 110 indicates the interactive area of the EPG 
5 to be chosen. 

However, referring to Fig. lOA or lOB, when a user moves 
the pointer/cursor 110 to the edge of the program matrix 108, 
the configuration of the pointer/cursor 110 changes to 
indicate to the user alternate or additional information. 

10 Fig. lOA shows that the cursor has changed into an icon that 
represents that the program matrix 10 8 may be shifted by an 
entire page. Alternatively, the pointer/cursor in this 
changed configuration, may perform some other command when 
activated. In addition, depending on the location of the 

15 pointer /cursor , the shape of the pointer/cursor may change and 
an additional informational window may appear. These 
additional informational windows 512 are designed to fade from 
view when the information provided is no longer necessary for 
the user or following a predetermined period of time, or a 

20 predetermined set of commands has been issued buy the user. 

Fig. IOC depicts a program guide 102, and an 
additional configuration for a pointer /cursor without the 
additional informational window 512. 
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WHAT IS CliAIMED IS: 

1 . A system for displaying information on an EPG 
screen comprising: 

an EPG display controller that processes display 
5 ' data to display an EPG display; 

a memory for storing an EPG database containing 
display data, and program data; 

a processor, coupled to the memory, and the EPG 
display controller, with processor configured to process: 
10 database engine program data to execute a 

database engine that generates EPG screen data; and 

display data that includes current time data, 
wherein said current time data includes data for 
causing said EPG display controller to display an 
15 EPG display of the viewer grid guide, wherein the 

current time data is depicted as displaying a 
portion of the viewer grid guide in shadow. 



2 . The system of claim 1 wherein EPG display 
20 controller displays the current time data, and time remaining 
data as a transparent overlying shadow that proceeds across 
the screen from left to right, graphically depicting the 
current time data and time remaining data. 

25 ; 3 . A system for directly invoking actions from 

interactive areas of an EPG displayed on a screen comprising: 
an EPG display controller that processes display 
data to display an EPG display, and including interactive 
areas, and displaying a pointer /cursor on the screen, 
30 with the interactive areas configured to invoke EPG 

actions, associated with interactive areas, when the 
interactive areas are selected by a viewer; 

a memory for storing an EPG database containing 
display data and program data; 
35 an input module that receives user pointer/cursor 

movement commands ; 
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a processor, coupled to the memory, the input 
module, and the EPG display controller, with processor 
configured to process: 

database engine program data to execute a 
5 database engine that generates EPG screen data; 

user interface program data to execute a user 
interface that user pointer/cursor movement 
commands, and generates response screens, with the 
user interface responsive to movement of the 
10 pointer /cursor over an interactive area to change 

the configuration of the display of the 
pointer /cursor to display alternate or additional 
information. 

15 4, The system of claim 9 wherein the display of 

the pointer/cursor varies to include an info screen and 
provide additional information upon being positioned in a 
predetermined location of the EPG display screen. 

5 . A system for directly invoking actions from 
interactive areas of an EPG displayed on a screen comprising: 
an EPG display controller that processes display 
data to display an EPG display, and including interactive 
areas, and displaying a pointer/cursor on the screen, 
with the interactive areas configured to invoke EPG 
actions, associated with interactive areas, when the 
interactive areas are selected by a viewer; 

a memory for storing an EPG database containing 
display data, where said display data includes program 
data; 

an input module that receives user pointer/cursor 
movement commands ; 

a processor, coupled to the memory, the input 
module, and the EPG display controller, with processor 
configured to process: 

database engine program data to execute a 
database engine that generates EPG screen data; 
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user interface program data to execute a user 
interface that user pointer/cursor movement 
commands, and generates response screens; and 

display data, wherein said display data 
includes data for causing said EPG display 
controller to display an EPG display including 
interactive areas in the forms of glyphs, wherein a 
first glyph is a guide time glyph that changes into 
a guide time bar glyph when activated, with said 
time bar glyph including a series of time indicator 
glyphs, with said user interface for generating 
display data listing future times available for the 
display of the EPG when said guide time bar glyph is 
activated and for generating a grid of channels and 
programs for a specific span of time when a specific 
time indicator glyph is activated, and where ,said 
program data includes data for causing said user 
interface to recursively vary the configuration of 
the EPG display when the viewer activates the 
glyphs . 

6. An on-screen menuing system for directly 
invoking actions from interactive areas of an EPG displayed on 
a screen comprising: 

an EPG display controller that processes display 
data to display an EPG display, and including interactive 
areas, and displaying a pointer/cursor on the screen, 
with the interactive areas configured to invoke EPG 
actioixs, associated with interactive areas, when the 
interactive areas are selected by a viewer; 

a memory for storing an EPG database containing 
display data, where said display data includes program 
data; 

an input module that receives user pointer/cursor 
movement commands ; 

a processor, coupled to the memory, the input 
module, and the EPG display controller, with processor 
configured to process: 
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database engine program data to execute a 
database engine that generates EPG screen data 
including: 

a main menu; 

at least one sub menu; and 
at least one host function that includes 
commands for controlling a plurality of connected 
electronic devices each configured to accept and 
perform the commands . 

7. A method of operating an on screen menu system 
for controlling integrated electronic devices comprising the 
steps of at least one of either: 

using an EPG display controller to display either a 
main menu, at least one sub menu or at least one host 
function that includes commands for controlling a 
plurality of connected electronic devices each configured 
to accept and perform the commands; 

selecting either a main menu, a sub menu or a host 
function that includes commands for controlling a 
plurality of connected electronic devices each configured 
to accept and perform the commands; and 

having the connected electronic devices accept and 
perform the selected host function commands. 
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earlier document published on or after the intcmationnJ filing date 

dociunexu which nmy throw doubts on priori^' claimCs) or wliich is 
cited to cslabluh the publication date of another citation or other 
qKcitd reason (as Bpeciilod) 

document rcferruig to an oral dtsclotiurc, use, exhibition or other 
means 

document published prior to the interantionol Glmg dale but bfer than 



"T" later document published after the intcmatjonui Citing date or priority 

dote and not in conflict witlk lhc application but cited to uiiderstnnd tJic 
principle or thcoiy umlcrlying tlic invention 

"X' document of p&rlicutur rvlcvancc; the claimed invention cannot he 

con»klcrod novel or connot be considered to involve un inventive i«tqp 
when the document is Inkuii nione 

'Y* document of particular relevance; llic cluijucd iiivcntian cminot be 

considerod to involve on inventive step when lljc document is 
combined with one or more other cuch doctuncnLs, «ut3h coixibinntjon 
being obvious to a peraon skilled in llio art 

document member of tiie same patent family 
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Box I Observations where certain claims were found unsearchable (Continuation of item 1 of first sheet) 



TlVis mlcmalioTial report has not been established in respect of odlain claims under Article 17(2)(a) for following reasons: 
1. I I Claims Nos.: 

because ihcy relate to subject mailer not required to be searched by this Authority, namely: 



□ 



Clainis Nos.: 

because Ihcy relate to parts of tlic inlcmalional application tliat do not comply with tlie prescribed requirements to such 
an extent that no meaningful international search can be carried out» speciHcally: 



3. 



X Claims Nos.: 4 

because they are dependent claims and arc not drafled in accordance with the second and Uiird sentences of Rule 6.4(a}. 



Box II Observations where unity of invention is lacking (Continuation of item 2 of first sheet) 



This Intemaliona) Searching Authority found multiple inventions in this international application, as follows: 



1 . I I As all required additional search fees were timely paid by the applicant, this international search report covers alJ searchable 
claims. 

2- I [ A.S all searchable claims could be searched without effort justifying an additional fee, this Authority did not invite payment 

of any additional fee. 

3- I I As only some of the required additional search fees were timely paid by Uic applicant, this intemalional search report covers 

only lliose claims for which fees were paid, specifically claims Nos.: 



4. { [ No required additional search fees were timely paid by the applicant. Consequently, this international sciirch report is 
restricted to liie invention ixrst mentioned in Uie claims; it is covered by claims Nos.: 



Remark on Protest j | The additional search fees were accompanied by the applica.nt'5 protest. 

I I No protest accompanied the payment of additional search fees. 
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